Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	26298
Missing cells	24503
Missing cells (%)	8.5%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	2.2 MiB
Average record size in memory	88.0 B

Variable types

Categorical	1
Numeric	10

Alerts

`time` has a high cardinality: 26298 distinct values	High cardinality
`tavg` is highly correlated with `tmin` and 3 other fields	High correlation
`tmin` is highly correlated with `tavg` and 2 other fields	High correlation
`tmax` is highly correlated with `tavg` and 1 other fields	High correlation
`wspd` is highly correlated with `wpgt`	High correlation
`wpgt` is highly correlated with `wspd`	High correlation
`tsun` is highly correlated with `tavg`	High correlation
`snow` is highly correlated with `tavg` and 1 other fields	High correlation
`snow` has 1346 (5.1%) missing values	Missing
`wdir` has 9229 (35.1%) missing values	Missing
`wspd` has 6956 (26.5%) missing values	Missing
`wpgt` has 6949 (26.4%) missing values	Missing
`time` is uniformly distributed	Uniform
`time` has unique values	Unique
`tmin` has 359 (1.4%) zeros	Zeros
`prcp` has 14627 (55.6%) zeros	Zeros
`snow` has 23661 (90.0%) zeros	Zeros
`tsun` has 4980 (18.9%) zeros	Zeros

Reproduction

Analysis started	2022-11-24 15:55:29.542286
Analysis finished	2022-11-24 15:57:51.900260
Duration	2 minutes and 22.36 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

time
Categorical

HIGH CARDINALITY
UNIFORM
UNIQUE

Distinct	26298
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	205.6 KiB

1950-01-01	1
1997-12-27	1
1998-01-06	1
1998-01-05	1
1998-01-04	1
Other values (26293)	26293

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	262980
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	26298 ?
Unique (%)	100.0%

Sample

1st row	1950-01-01
2nd row	1950-01-02
3rd row	1950-01-03
4th row	1950-01-04
5th row	1950-01-05

Common Values

Value	Count	Frequency (%)
1950-01-01	1	< 0.1%
1997-12-27	1	< 0.1%
1998-01-06	1	< 0.1%
1998-01-05	1	< 0.1%
1998-01-04	1	< 0.1%
1998-01-03	1	< 0.1%
1998-01-02	1	< 0.1%
1998-01-01	1	< 0.1%
1997-12-31	1	< 0.1%
1997-12-30	1	< 0.1%
Other values (26288)	26288	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
1950-01-01	1	< 0.1%
1950-01-17	1	< 0.1%
1950-01-07	1	< 0.1%
1950-01-08	1	< 0.1%
1950-01-09	1	< 0.1%
1950-01-10	1	< 0.1%
1950-01-11	1	< 0.1%
1950-01-12	1	< 0.1%
1950-02-19	1	< 0.1%
1950-01-13	1	< 0.1%
Other values (26288)	26288	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
-	52596	20.0%
1	47586	18.1%
0	46815	17.8%
9	29167	11.1%
2	26770	10.2%
8	11035	4.2%
5	11031	4.2%
7	11031	4.2%
6	10964	4.2%
3	8675	3.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	210384	80.0%
Dash Punctuation	52596	20.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	47586	22.6%
0	46815	22.3%
9	29167	13.9%
2	26770	12.7%
8	11035	5.2%
5	11031	5.2%
7	11031	5.2%
6	10964	5.2%
3	8675	4.1%
4	7310	3.5%

Dash Punctuation

Value	Count	Frequency (%)
-	52596	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	262980	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
-	52596	20.0%
1	47586	18.1%
0	46815	17.8%
9	29167	11.1%
2	26770	10.2%
8	11035	4.2%
5	11031	4.2%
7	11031	4.2%
6	10964	4.2%
3	8675	3.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	262980	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
-	52596	20.0%
1	47586	18.1%
0	46815	17.8%
9	29167	11.1%
2	26770	10.2%
8	11035	4.2%
5	11031	4.2%
7	11031	4.2%
6	10964	4.2%
3	8675	3.3%

tavg
Real number (ℝ)

HIGH CORRELATION

Distinct	430
Distinct (%)	1.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10.71841965

Minimum	-17.6
Maximum	31.6
Zeros	92
Zeros (%)	0.3%
Negative	1975
Negative (%)	7.5%
Memory size	205.6 KiB

Quantile statistics

Minimum	-17.6
5-th percentile	-1.4
Q1	5
median	10.8
Q3	16.7
95-th percentile	22.4
Maximum	31.6
Range	49.2
Interquartile range (IQR)	11.7

Descriptive statistics

Standard deviation	7.52784232
Coefficient of variation (CV)	0.7023276345
Kurtosis	-0.6424771782
Mean	10.71841965
Median Absolute Deviation (MAD)	5.9
Skewness	-0.1210460448
Sum	281873
Variance	56.66840999
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5	160	0.6%
13	157	0.6%
4.4	157	0.6%
6.8	156	0.6%
14.8	153	0.6%
5.8	151	0.6%
15.4	151	0.6%
17.4	151	0.6%
16.6	150	0.6%
7.4	148	0.6%
Other values (420)	24764	94.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-17.6	1	< 0.1%
-14.4	1	< 0.1%
-14	1	< 0.1%
-13.7	1	< 0.1%
-13.6	1	< 0.1%
-13.5	1	< 0.1%
-13.4	1	< 0.1%
-13.1	1	< 0.1%
-12.8	1	< 0.1%
-12.7	1	< 0.1%

Value	Count	Frequency (%)
31.6	1	< 0.1%
30.9	1	< 0.1%
30.7	1	< 0.1%
30.2	1	< 0.1%
29.9	1	< 0.1%
29.8	2	< 0.1%
29.6	2	< 0.1%
29.5	1	< 0.1%
29.4	1	< 0.1%
29.3	1	< 0.1%

tmin
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	403
Distinct (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6.244539509

Minimum	-21.1
Maximum	22.3
Zeros	359
Zeros (%)	1.4%
Negative	4647
Negative (%)	17.7%
Memory size	205.6 KiB

Quantile statistics

Minimum	-21.1
5-th percentile	-4.6
Q1	1.3
median	6.4
Q3	11.6
95-th percentile	16.4
Maximum	22.3
Range	43.4
Interquartile range (IQR)	10.3

Descriptive statistics

Standard deviation	6.682959394
Coefficient of variation (CV)	1.070208521
Kurtosis	-0.3302180031
Mean	6.244539509
Median Absolute Deviation (MAD)	5.2
Skewness	-0.2794648095
Sum	164218.9
Variance	44.66194626
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	359	1.4%
13	180	0.7%
5	174	0.7%
0.4	159	0.6%
4.8	159	0.6%
1.6	158	0.6%
6	155	0.6%
6.4	154	0.6%
1	153	0.6%
3	152	0.6%
Other values (393)	24495	93.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-21.1	1	< 0.1%
-21	1	< 0.1%
-20.5	1	< 0.1%
-19.3	1	< 0.1%
-19.2	2	< 0.1%
-18.7	2	< 0.1%
-18.6	2	< 0.1%
-18.3	2	< 0.1%
-18	1	< 0.1%
-17.7	1	< 0.1%

Value	Count	Frequency (%)
22.3	2	< 0.1%
22.2	1	< 0.1%
22.1	2	< 0.1%
21.9	1	< 0.1%
21.8	1	< 0.1%
21.7	1	< 0.1%
21.6	2	< 0.1%
21.5	1	< 0.1%
21.4	2	< 0.1%
21.2	5	< 0.1%

tmax
Real number (ℝ)

HIGH CORRELATION

Distinct	476
Distinct (%)	1.8%
Missing	12
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	15.33199041

Minimum	-13
Maximum	70
Zeros	92
Zeros (%)	0.3%
Negative	791
Negative (%)	3.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	-13
5-th percentile	1.2
Q1	8.4
median	15.5
Q3	22.3
95-th percentile	29.3
Maximum	70
Range	83
Interquartile range (IQR)	13.9

Descriptive statistics

Standard deviation	8.86628251
Coefficient of variation (CV)	0.5782864632
Kurtosis	-0.5912898123
Mean	15.33199041
Median Absolute Deviation (MAD)	6.9
Skewness	0.001366055943
Sum	403016.7
Variance	78.61096554
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10	133	0.5%
21	133	0.5%
21.3	129	0.5%
21.2	124	0.5%
9	122	0.5%
11.6	121	0.5%
11	120	0.5%
19.7	117	0.4%
22.7	117	0.4%
18.8	116	0.4%
Other values (466)	25054	95.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-13	1	< 0.1%
-10.6	2	< 0.1%
-10.4	1	< 0.1%
-10	2	< 0.1%
-9.5	1	< 0.1%
-9	1	< 0.1%
-8.9	1	< 0.1%
-8.8	2	< 0.1%
-8.7	3	< 0.1%
-8.4	3	< 0.1%

Value	Count	Frequency (%)
70	4	< 0.1%
39.8	1	< 0.1%
39.5	1	< 0.1%
39	1	< 0.1%
38.9	2	< 0.1%
38.8	1	< 0.1%
38.5	1	< 0.1%
38.3	2	< 0.1%
38.1	1	< 0.1%
38	1	< 0.1%

prcp
Real number (ℝ_≥0)

ZEROS

Distinct	321
Distinct (%)	1.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.707517682

Minimum	0
Maximum	103.1
Zeros	14627
Zeros (%)	55.6%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1.5
95-th percentile	9
Maximum	103.1
Range	103.1
Interquartile range (IQR)	1.5

Descriptive statistics

Standard deviation	3.998482827
Coefficient of variation (CV)	2.341693365
Kurtosis	47.45184898
Mean	1.707517682
Median Absolute Deviation (MAD)	0
Skewness	5.038111356
Sum	44904.3
Variance	15.98786492
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	14627	55.6%
0.1	937	3.6%
0.2	624	2.4%
0.3	511	1.9%
0.5	379	1.4%
0.4	371	1.4%
0.6	309	1.2%
0.7	285	1.1%
0.8	276	1.0%
1	221	0.8%
Other values (311)	7758	29.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	14627	55.6%
0.1	937	3.6%
0.2	624	2.4%
0.3	511	1.9%
0.4	371	1.4%
0.5	379	1.4%
0.6	309	1.2%
0.7	285	1.1%
0.8	276	1.0%
0.9	217	0.8%

Value	Count	Frequency (%)
103.1	1	< 0.1%
72	1	< 0.1%
63	1	< 0.1%
57.7	1	< 0.1%
56.7	1	< 0.1%
51.5	1	< 0.1%
49.2	1	< 0.1%
49.1	2	< 0.1%
48.1	1	< 0.1%
47.3	1	< 0.1%

snow
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING
ZEROS

Distinct	28
Distinct (%)	0.1%
Missing	1346
Missing (%)	5.1%
Infinite	0
Infinite (%)	0.0%
Mean	2.794565566

Minimum	0
Maximum	300
Zeros	23661
Zeros (%)	90.0%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	10
Maximum	300
Range	300
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	16.28499899
Coefficient of variation (CV)	5.827381253
Kurtosis	75.91924736
Mean	2.794565566
Median Absolute Deviation (MAD)	0
Skewness	7.948278888
Sum	69730
Variance	265.2011921
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=28)

Value	Count	Frequency (%)
0	23661	90.0%
10	285	1.1%
20	223	0.8%
30	143	0.5%
40	79	0.3%
50	74	0.3%
100	67	0.3%
80	66	0.3%
60	62	0.2%
70	58	0.2%
Other values (18)	234	0.9%
(Missing)	1346	5.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	23661	90.0%
10	285	1.1%
20	223	0.8%
30	143	0.5%
40	79	0.3%
50	74	0.3%
60	62	0.2%
70	58	0.2%
80	66	0.3%
90	55	0.2%

Value	Count	Frequency (%)
300	1	< 0.1%
260	4	< 0.1%
250	1	< 0.1%
240	3	< 0.1%
230	2	< 0.1%
220	2	< 0.1%
210	4	< 0.1%
200	6	< 0.1%
190	5	< 0.1%
180	9	< 0.1%

wdir
Real number (ℝ_≥0)

MISSING

Distinct	361
Distinct (%)	2.1%
Missing	9229
Missing (%)	35.1%
Infinite	0
Infinite (%)	0.0%
Mean	184.5266858

Minimum	0
Maximum	360
Zeros	90
Zeros (%)	0.3%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	0
5-th percentile	10
Q1	114
median	191
Q3	249
95-th percentile	349
Maximum	360
Range	360
Interquartile range (IQR)	135

Descriptive statistics

Standard deviation	103.1560859
Coefficient of variation (CV)	0.5590307193
Kurtosis	-0.8412103719
Mean	184.5266858
Median Absolute Deviation (MAD)	65
Skewness	-0.1596919697
Sum	3149686
Variance	10641.17806
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
187	133	0.5%
172	130	0.5%
192	129	0.5%
191	127	0.5%
183	121	0.5%
182	120	0.5%
189	120	0.5%
190	118	0.4%
184	116	0.4%
197	114	0.4%
Other values (351)	15841	60.2%
(Missing)	9229	35.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	90	0.3%
1	90	0.3%
2	90	0.3%
3	74	0.3%
4	80	0.3%
5	94	0.4%
6	76	0.3%
7	65	0.2%
8	73	0.3%
9	85	0.3%

Value	Count	Frequency (%)
360	5	< 0.1%
359	82	0.3%
358	81	0.3%
357	80	0.3%
356	87	0.3%
355	67	0.3%
354	90	0.3%
353	79	0.3%
352	79	0.3%
351	68	0.3%

wspd
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	100
Distinct (%)	0.5%
Missing	6956
Missing (%)	26.5%
Infinite	0
Infinite (%)	0.0%
Mean	9.7010547

Minimum	0
Maximum	37.8
Zeros	5
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	0
5-th percentile	3.6
Q1	6.1
median	9
Q3	12.2
95-th percentile	18.4
Maximum	37.8
Range	37.8
Interquartile range (IQR)	6.1

Descriptive statistics

Standard deviation	4.633108409
Coefficient of variation (CV)	0.4775881131
Kurtosis	1.148992072
Mean	9.7010547
Median Absolute Deviation (MAD)	2.9
Skewness	0.9354449428
Sum	187637.8
Variance	21.46569353
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.6	691	2.6%
6.8	686	2.6%
8.3	679	2.6%
7.2	675	2.6%
6.1	668	2.5%
5.8	668	2.5%
6.5	660	2.5%
7.9	653	2.5%
5.4	635	2.4%
9	624	2.4%
Other values (90)	12703	48.3%
(Missing)	6956	26.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5	< 0.1%
0.4	19	0.1%
0.7	15	0.1%
1.1	31	0.1%
1.4	44	0.2%
1.8	62	0.2%
2.2	89	0.3%
2.5	135	0.5%
2.9	157	0.6%
3.2	250	1.0%

Value	Count	Frequency (%)
37.8	1	< 0.1%
36.7	1	< 0.1%
34.9	2	< 0.1%
32.4	1	< 0.1%
31	3	< 0.1%
30.2	5	< 0.1%
29.9	5	< 0.1%
29.5	4	< 0.1%
29.2	5	< 0.1%
28.8	4	< 0.1%

wpgt
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	266
Distinct (%)	1.4%
Missing	6949
Missing (%)	26.4%
Infinite	0
Infinite (%)	0.0%
Mean	30.82724689

Minimum	2.9
Maximum	130
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	2.9
5-th percentile	12.6
Q1	21.6
median	28.8
Q3	38.2
95-th percentile	55.4
Maximum	130
Range	127.1
Interquartile range (IQR)	16.6

Descriptive statistics

Standard deviation	13.37380902
Coefficient of variation (CV)	0.4338307947
Kurtosis	1.730543295
Mean	30.82724689
Median Absolute Deviation (MAD)	8.3
Skewness	0.9728546926
Sum	596476.4
Variance	178.8587676
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
25.2	373	1.4%
18	330	1.3%
21.6	328	1.2%
28.8	321	1.2%
32.4	286	1.1%
23.4	246	0.9%
25.9	245	0.9%
22.3	244	0.9%
25.6	242	0.9%
28.1	240	0.9%
Other values (256)	16494	62.7%
(Missing)	6949	26.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.9	1	< 0.1%
3.6	1	< 0.1%
4	2	< 0.1%
4.3	2	< 0.1%
5	1	< 0.1%
5.4	8	< 0.1%
5.8	4	< 0.1%
6.1	6	< 0.1%
6.5	11	< 0.1%
6.8	8	< 0.1%

Value	Count	Frequency (%)
130	1	< 0.1%
117	1	< 0.1%
114.5	1	< 0.1%
112	1	< 0.1%
103.3	1	< 0.1%
102.2	1	< 0.1%
101.5	1	< 0.1%
100.8	1	< 0.1%
100.4	1	< 0.1%
98.3	1	< 0.1%

pres
Real number (ℝ_≥0)

Distinct	586
Distinct (%)	2.2%
Missing	7
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	1016.208048

Minimum	970.8
Maximum	1046
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	970.8
5-th percentile	1001.7
Q1	1011.1
median	1016.3
Q3	1021.6
95-th percentile	1030.2
Maximum	1046
Range	75.2
Interquartile range (IQR)	10.5

Descriptive statistics

Standard deviation	8.512573648
Coefficient of variation (CV)	0.008376802036
Kurtosis	0.5405641174
Mean	1016.208048
Median Absolute Deviation (MAD)	5.2
Skewness	-0.1879056471
Sum	26717125.8
Variance	72.46391012
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1014.9	163	0.6%
1015.2	159	0.6%
1014.8	157	0.6%
1017.2	150	0.6%
1015.9	149	0.6%
1016.7	148	0.6%
1017	147	0.6%
1017.8	147	0.6%
1016.4	147	0.6%
1015.7	146	0.6%
Other values (576)	24778	94.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
970.8	1	< 0.1%
972.1	1	< 0.1%
972.7	1	< 0.1%
977.9	1	< 0.1%
978.5	1	< 0.1%
979.9	1	< 0.1%
981	1	< 0.1%
981.2	1	< 0.1%
981.6	1	< 0.1%
982.2	1	< 0.1%

Value	Count	Frequency (%)
1046	1	< 0.1%
1045.5	2	< 0.1%
1044.5	1	< 0.1%
1043.9	1	< 0.1%
1043.8	1	< 0.1%
1043.4	1	< 0.1%
1043.2	1	< 0.1%
1043	1	< 0.1%
1042.9	1	< 0.1%
1042.6	1	< 0.1%

tsun
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	586
Distinct (%)	2.2%
Missing	4
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	283.8643797

Minimum	0
Maximum	948
Zeros	4980
Zeros (%)	18.9%
Negative	0
Negative (%)	0.0%
Memory size	205.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	24
median	222
Q3	492
95-th percentile	774
Maximum	948
Range	948
Interquartile range (IQR)	468

Descriptive statistics

Standard deviation	264.0536307
Coefficient of variation (CV)	0.9302105144
Kurtosis	-0.900824564
Mean	283.8643797
Median Absolute Deviation (MAD)	216
Skewness	0.5802123319
Sum	7463930
Variance	69724.31987
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4980	18.9%
6	528	2.0%
12	426	1.6%
18	357	1.4%
24	305	1.2%
30	283	1.1%
36	261	1.0%
48	250	1.0%
42	241	0.9%
60	235	0.9%
Other values (576)	18428	70.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4980	18.9%
1	4	< 0.1%
2	10	< 0.1%
3	7	< 0.1%
4	4	< 0.1%
5	4	< 0.1%
6	528	2.0%
7	4	< 0.1%
8	4	< 0.1%
9	5	< 0.1%

Value	Count	Frequency (%)
948	1	< 0.1%
942	1	< 0.1%
936	4	< 0.1%
930	4	< 0.1%
929	2	< 0.1%
928	1	< 0.1%
924	10	< 0.1%
922	1	< 0.1%
921	1	< 0.1%
920	1	< 0.1%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	time	tavg	tmin	tmax	prcp	wdir	wspd	wpgt	pres	tsun
0	1950-01-01	-2.1	-4.8	2.8	0.0	NaN	NaN	NaN	1031.4	408.0
1	1950-01-02	0.6	-5.7	2.8	13.2	NaN	NaN	NaN	1021.8	0.0
2	1950-01-03	2.5	1.0	4.8	0.8	NaN	NaN	NaN	1012.6	0.0
3	1950-01-04	3.9	1.4	5.3	3.4	NaN	NaN	NaN	1010.7	12.0
4	1950-01-05	5.3	1.7	7.1	1.0	NaN	NaN	NaN	1009.3	0.0
5	1950-01-06	5.0	2.7	8.3	0.0	NaN	NaN	NaN	1012.6	222.0
6	1950-01-07	4.9	1.4	7.2	0.0	NaN	NaN	NaN	1019.3	6.0
7	1950-01-08	0.4	-1.6	5.1	0.0	NaN	NaN	NaN	1021.8	282.0
8	1950-01-09	1.6	-2.1	3.7	0.0	NaN	NaN	NaN	1018.5	126.0
9	1950-01-10	4.4	0.0	5.8	0.0	NaN	NaN	NaN	1026.9	0.0

Last rows

	time	tavg	tmin	tmax	prcp	wdir	wspd	wpgt	pres	tsun
26288	2021-12-22	-3.0	-6.7	1.7	0.0	340.0	3.2	13.3	1025.8	450.0
26289	2021-12-23	0.8	-4.3	6.5	0.0	149.0	12.6	29.2	1015.5	0.0
26290	2021-12-24	7.8	6.3	9.1	6.6	164.0	9.4	25.2	1007.2	0.0
26291	2021-12-25	5.3	2.4	7.5	4.0	356.0	6.5	18.7	1005.9	0.0
26292	2021-12-26	2.5	1.6	3.5	5.7	311.0	5.0	12.6	1007.5	0.0
26293	2021-12-27	7.2	3.2	10.9	2.7	150.0	6.8	22.3	1002.8	122.0
26294	2021-12-28	9.1	7.7	11.2	6.9	162.0	16.6	56.9	998.7	5.0
26295	2021-12-29	9.7	8.6	11.5	4.0	187.0	14.4	43.6	1009.0	4.0
26296	2021-12-30	13.0	10.6	15.2	0.6	169.0	11.5	28.1	1019.2	19.0
26297	2021-12-31	11.4	9.3	13.4	0.0	166.0	11.2	27.7	1023.3	337.0

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Dash Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows